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Remarks 

Applicant's undersigned representative thanks Examiner Wong for the helpful and very 
courteous discussion held on May 9, 2006. As discussed, the claims have been amended to 
recite a formula by -which the target frame bit rate is distributed among the objects) in the frame, 
and lo include recursively adjusting the target frame bit rate for each frame in the sequence. The 
following remarks shall summarize and further expand upon topics discussed 

The present invention relates to a method for allocating bits to encode each frame of an 
image sequence, where each frame of the image sequence has at least one object The method 
(as set forth in amended Claim 22 above) generally comprises: 

(a) determining a target frame bit rate* T^mc for the frame; 

(b) allocating the target frame bit rate among the at least one object in 
accordance with the formula: 

Vi-KixTfo^ 

where V ( is a target object bit rate for each object, and Kj is proportional to an average pixel 
value for the object; and 

(c) recursively adjusting the target frame bit rate for each frame in the 

sequence. 

In further embodiments, the present invention relates to a computer-readable medium 
(containing instructions generally to perform the present method; see amended Claim 32 above), 
and an apparatus for encoding each frame of an image sequence. The apparatus (as set forth in 
amended Claim 29 above) generally comprises: 

(a) a motion compensator for generating a predicted image of a current frame; 

(b) a transform module for applying a transformation to a difference signal 
between the current frame and the predicted image, where the transformation produces a 
plurality of coefficients; 
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(c) a quantizer for quantizing the plurality of coefficients with at least one 
quantizer scale; and 

(d) a controller for selectively adjusting the at least one quantiser scale for a 
current frame in response to a target object bit rate for the at least one object, and for dete rminin g 
the target object bit rate from a target frame bit tale in accordance with the formula: 

V| a K|XT<hmtc 

where Vj is a target object bit rate for each object, and Kf is proportional to an average pixel 
value for the object 

The reference cited against the claims (Eleftheriadis et aL, US* Pat No. 6,055,330 
[hereinafter "Hefibcriadis"]) does not disclose allocating a target frame bit rate among the 
objcct(s) in a frame according to an average pixel value for die object, nor does Eleftheriadis et 
ah disclose the present recursive adjustment step (see amended Claim 22). Furthermore, 
Eleftheriadis does not disclose a controller for determining the target object bit rate from a target 
frame bit rate in accordance with on average pixel value for the object (see amended Claim 29), 
Consequently, the present claims are patentable over the cited references. 

Claim Rcicctions UnderJIie Judiciallv Created Poclrine Of Double Patenting 

Applicants provisionally agree to file a terminal disclaimer to overcome the non-statutory 
double patenting rejection of claims 22-24, 27-34 and 37-38. In particular, Applicants will file 
the terminal disclaimer if and when all of the other claim rejections have been resolved 

Claim Rejection Under 35 U»SX,_£1 02fe) 

The rejection of claims 22-30 and 32-50 under 35 U-S.C. §1 02(e) as being anticipated by 
Eleftheriadis is respectfully traversed and should be withdrawn, 

Eleftheriadis discloses a method and apparatus for performing digital image and video 
segmentation and compression using 3-D depth information (Title), In contrast to the present 
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claims 22 and 32, which recite allocating the target object bit rate(s) in accordance with the 
target ftamc rate and an average pixel value for the object, Eleftbcriadis appears to determine a 
target object bit rate based on a quantizer (the value of which appears to be related to the distance 
of the object from the camera; see, e,g^ col 1 1, IL 1-15 and 41-44) and the proportion of pixels 
in the object (see, c.g,, coL 1 1, L 65-col, 12, L 10). Thus, Eleflheriadis does not anticipate the 
present allocating step of claims 22 and 32. 

Furthermore, Eleftbcriadis teaches that the frame bit rate is given (e.g„ determined a 
priori* and apparently dependent on the bandwidth of the channel which is accepting data from 
the buffer; see p, 9 of the Amendment filed December 15, 2005)* Thus, Eleftbcriadis appears to 
be silent with regard to recursively adjusting a target Same rate, as recited in claims 22 and 32. 
Therefore, Eleflheriadis docs not anticipate the present claims 22 and 32, 

For example, Eleftbcriadis discusses two coding techniques for controlling bit rates, 
variable bit rate (VBR) coding and constant bit rale (CBR) coding (see col. 8, U, 8-19 and col 
1 1, 11. 39-64). Eleflheriadis discloses a constant bit rate encoder (FIG. 1 0), in which an object 
map generated by object segmentation circuit 500 is received by a macroblock labeling circuit 
UOO (see coL 10 J. 65-coL 11, L 1). Since the encoder splits each frame of video information 
received from the camera into macroblocks and quantizes DCT coefficients on a macroblock 
basis, Eleflheriadis teaches that it is desirable to assign each macroblock of video data to a 
specific object; or in the case of a simple segmentation technique described therein, to a region 
which contains one or more objects at the same depth from the camera (col 11, U* 1-8)- Once 
the macroblock including pixels from an object or region has been assigned, it will be assigned 
to one object or region by macroblock labeling circuit 1100, a rate controller 1040 can select an 
appropriate quantizer step si2c for the entire current macroblock (col. 1 1 , 11* 12-15). 

For CBR coding, the rate controller 1040 must additionally regulate quantizer selection 
so that the output buffer 1020 neither overflows nor underflows* Since the total number of bits 
per second which may be output is now fixed, object sizes become important (col, 1 1, 11* 53-57; 
emphasis added). In accordance with a known technique for performing area-selective rate 
control when the object locations are known, each object is associated with a particular target 
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average bit rate R|, except for the background (object n). Thus, in CBR coding, Eleftheriadis 
appears to determine a target object bit rate based on a quantizer value, rather than an allocation 
in accordance with the target frame rale, as recited in the present claims 22 and 32. 

In order to maintain the given total average rate R necessary to prevent buffer overflow, 
the background rate is determined according to EQ. (4): 

•a w 

2^^ = * 

where a\ is the proportion (from 0.0 to 1*0) of the pixels in the frame that belong to object i (col. 
1 U 1* 67-col. 12, 1. 10; emphasis added)- Thus, Eleftheriadis determines a target object bit rate 
based on tltc proportion of pixels in the object, rather than an average pixel value for the object 
Thus, Eleftheriadis does not antt cipatc the allocating step recited in the present claims 22 and 32. 

Elefthcriadis explicitly teaches that it is possible that R n (the background bit rate) is 
negative (coL 12, 1. 16), To one of ordinary skill in the art, this possibility of a negative 
background bit rate demonstrates that target object bit rates are not allocated in accordance with 
a target frame rate. Rather, they must be determined by some other technique (such as in 
accordance with a quantizer value, as explained above, which in turn appears to be based on the 
occupancy B W nx of a buffer [coL 3, 11. 22-26], the output rate of which is constant and dependant 
on the bandwidth of lite channel which is accepting data from the buffer; sec coL 3, 11. 17-22). 
Eleftheriadis further teaches that the possibility of a negative background bit rate may simply 
have the effect of assigning as coarse quantization as possible to the background, and may result 
in less average bits per second per object than the target bit rates Ri indicate (col. 12, 1. 16-19), 
further confirming that target object bit rates therein are not allocated in accordance with a target 
frame rate. 

Thus, there appears to be no reasonable basts in Eleftheriadis for an assertion that EQ. (4) 
is used to determine the target frame rate; to the extent R may be related to a target frame rate, 
Eleftheriadis teaches that it is given (as discussed in the preceding paragraph, dependent on the 
bandwidth of the channel which is accepting data from the buffer)* Consequently, in the relevant 
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discussion of CBR coding, Eleftheriadis fails to disclose step of allocating the target frame bit 
rate in accordance with a target object bit rate as presently claimed* 

Also, as discussed above, since Elefihcriadis teaches that the frame bit rate is related to 
the occupancy of a buffer having a constant output rate that is, in turn, dependent on the 
bandwidth of the channel which is accepting data from the buffer, Eleftheriadis cannot disclose 
of suggest to one of ordinary skill in the art that the frame bit rate can be (much less should be) 
adjusted* Thus, Eleftheriadis appears to be silent with regard to recursively adjusting a target 
frame rate, as recited in claims 22 and 32. 

For VBR coding, lalcfthcriadis teaches thai macroblodc labels can be directly used for 
rate control by associating particular quantizer step sizes with each object Ceol. U, 11 39-41), 
The encoder can also employ techniques to "smooth out" quantizer differences at object 
boundaries by gradually changing the quantization step while entering or exiting an object (coL 
11, U. 47-50). A macroblock labeling circuit 1100 (see FIG. 11) contains object identifications 
for each pixel in the macroblock (col. 11, 11. 16-19), and quantizer selection is simply a lookup 
operation into a table which indexes the possible object identifications generated by macroblock 
labeling circuit 1100 (col- 11, IL 44-47). Also, Elcfthcriadis teaches that rate control is also 
usable in a purely VBR encoder to provide higher quality for some image areas, and less for 
areas that have smaller significance (e.g., background areas). As a result, the term rate control is 
used by Eleftheriadis generally without discriminating whether or not a CBR or VBR encoder is 
used (col. 8, 11. 40-47). Thus, the discussion of VBR coding by Eleftheriadis fails to cure any 
deficiency of Eleftheriadis with regard to the allocating step in the present claims 22 and 32. 

Consequently, Eleftheriadis fails to disclose the steps of (i) allocating the target Jxame bit 
rate in accordance with an average pixel value for the object and (ii) recursively adjusting the 
target frame bit rate, as presently recited in claims 22 and 32. As such, Eleftheriadis does not 
anticipate the present claims 22 and 32, Therefore, this ground of rejection should be withdrawn 
with regard to claims 22, 32, and claims dependent therefrom. 

Furthermore, Eleftheriadis fails to disclose the controller of claim 29, which determines 
the target object bit rate from a target frame bit rate in accordance with an average pixel value for 
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the object As discussed above, Elcfihcriadis determines a target object bit rate based on the 
proportion of pixels in tlte object, rather than an average pixel value for the object In addition, 
Elcfihcriadis discloses a rate controller 1040 that regulates quantizer selection so that the output 
buffer 1020 neither overflows nor underflows (col. 11, 11. 53-57), However, the output rate of 
the buffer is constant and dependant on the bandwidth of the channel which is accepting data 
from the buffer (see coL 3, 1L 17-26). Eleftheriadis docs not appear to disclose any connection 
between the bandwidth of the channel which is accepting data from the buffer and a target frame 
bit rate. As a result, Eleftheriadis foils to disclose each and every clement of the present claim 



In view of the above amendments and remarks, all bases for rejection arc overcome, and 
the application is believed to be in condition for allowance. Early notice to that effect is 
earnestly requested, 

IF it is deemed helpful or beneficial to the efficient prosecution of the present application, 
the Examiner is invited to contact Applicant's undersigned representative by telephone. 



Therefore, this ground of rejection should be withdrawn. 



Conclusions 



Respectfully submitted, 




Andrew Fortacy, PhJD. 
Reg, No. 34,600 



401 W. Fallbrook Avenue, Suite 204 
Fresno, California 93711 



(559)432-6847 
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